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ABSTRACT 

This report traces the development of 20 objective 
test items for secondary mathematics, part of an Evaluation Project 
designed to compile a reservoir of items to serve as prototypes for 
teacher-constructed tests. The report first shows how an individual 
item is written and tested. Next, a classification system of items by 
subject matter and pupil response is described. The four categories 
used for pupil response are the abilities to recall standard 
procedures, to apply them, to choose the correct process, and to 
devise original methods. This system is illustrated by a test 
consisting of 20 items covering these four categories in each of five 
topic areas taken from Form 3 mathematics (approximately grade nine) . 
Lastly, the report describes the standardization of this test, 
including the preliminary trial, the choice of a representative 
student sample, the administration of the test, and the item analysis 
of the results. (MM) 
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EVALUATION PROJECT 
SECONDARY MATHEMATICS 



Much of the current re-appraisal of school practices concerns 
the role of the class teacher in assessment of his pupils, and a desire to 
improve on past techniques in this area. The Evaluation Project has been 
initiated to help teachers construct better tests of mathematics achievement. 
Its main purpose is to compile a reservoir of suitably-tested evaluation items 
which can be used as prototypes by teachers if they so desire. 

In the field of secondary mathematics, there are additional 
reasons for the creation of such an item bank. The changing nature of school 
mathematics means that evaluation techniques must be modified no matter how 
satisfactory they nay have, been in the past. It is hoped that teachers will 
acquire a deeper understanding of the objectives and methods of the new courses 
through a study of the evaluation items themselves and the manner in which they 
were developed. 



It should bo emphasized that the items collected in this Project 
are merely prototype items. Those have been shown to teat successfully some 
levels of cognitive thought relevant to mathematics in schools. If they provide 
the stimulus for teachers to re-examine their own evaluation techniques then the 
project will have been worth while. 

This report traces the development of twenty items for the 
secondary mathematics item bank at the form 3 level, during 1969# The 
time-consuming nature of item construction and validation is illustrated by 
following the procedure from the beginning. It .^Ls. shown that items cannot 
be judged on appearance alone - an item which appears satisfactory on the 
surface may in fact be worthless or misleading as an evaluation instrument. 

Collection of Items . . 

The initial step in the construction of an item bank is to ! 
collect a large number of raw items from various sources. It is most unwise ’ 
to. use items taken from published tests. By so doing the tost will bo 
invalidated. Most published tests depend for their effectiveness on the pupils 
being unfamiliar with the items in the test ;\ familiarity with some items may 
render t^o .test worthless. Text books and experienced teachers with some 
knowledge of measurement techniques have been the mein sources of items used in 
this report* 

Questions obtained directly from text books are often, 
unsatisfactory' evaluation items. This is not a criticism of the questions 
found in text books, as they are not designed for this purpose. Most modem 
text, book authors design a large nunbor of their exercises so that the pupils 
leam fraa doing them - they are teaching items, not evaluation items. 

However, text book questions con provide the stimulus for the construction of. 
more satisfactory items. 

An example of the refinement that is necessary to produce 
satisfactory evaluation items will illustrate the process involved, and also 
the frustrating nature of item construction. The following question was 
obtainod from a text! book: 

••Is 6 a factor of 3n if n is (i) an odd integer 

(ii) an even integer?" 



The question asks for two "yos-or-no" answers, necessitating 
an awareness by the pupil that even members contain 2 as a factor* It is 
a satisfactory text-book question in that the pupils oust examine whether 3n 
is odd or even. Sone class discussion nay even take place on this point and the 
sane principle nay be used in nore ccnplicated examples as later questions. 

It is a good teaching iten if properly used. 

The question was not satisfactory for evaluation purposes for the 
following reasons: 

1. There is a 50/o chance of guessing each answer. 

2. Pupils are aware from past experience that one answer to 
such questions is "yes" and the other is "no", and the word 
"oven" in the second part will provide the necessary clue os to 
which are the correct answers. The correct answers nay thus 

be obtained without investigating the question in the intended 
Conner. 

3. There is no way of knowing how the pupils obtained their 
answers, and thus the teacher will not know any nore about the 
pupils* achievement levels than he did befoi >. ■ 

'The /question' was therefore altered' to the following form 

"If n is an even number, what is the largest factor that 

3n MUST- have? 

A. 2 

B. 3 ' ' . •' 

C. 12 

' D. 6 

E. a number which, cannot be determined fren the 

information." 

,-:The objections raised above were now overcome. The pupils. have 
3 l choice of five answers, and four are designed to follow from various 
incorrect nethods of approach. . Not only can the teacher tell, from the selected 
answer whether or. not a pupil can "do" the question but an incorrect answer 
will. reveal a. clear deficiency in the pupil*s methods of thought*. Each 
iistractor is designed to appeal ..to a particular line of approach, by the pupil* 

The construction of suitable incorrect distraetors is. a task . • 
that is quite os demanding as constructing the item itself. No distr a stoac. 
should be so obviously wrong that it will be discarded without full consideration* 
If suitably designed, incorrect choices con be just as informative . as correct 
choice to the teacher who is evaluating his pupils* 

There are. many pttfal Is in the construction of distraetors* 

These ore discussed in most books on test construction. Perhaps the most 
commonly - occurring fault is in making the correct answer eithor much longer 
or much shorter than the others , thus making it stand out to the alert 
pupil* Often the correct answer is couched in more exact terms than the others, 
which is another- clue to the pupil searching for the .correct response* 

A preliminary trial of the item in this form, along with the 
other "19 items that had been constructed, revealed that it was an unsatisfactory 
item. The distract or E was, much, too appealing, and the correct answer (D) was 
chosen by only a very small number of pupils, as the following table shows* 

The upper group consisted of tho 30 . pupils who obtained the marks .on the test as 
a whole, and the lower group consisted of the 30 pupils who obtained the 
lowest narks on the test ns a whole* 
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Response 


A 


B 


C ' - 


. D 


E 


Upper group (N=30) 


2 


5 


1 


’■ 4 


18 


Lower group (N=30) 


1 .. 


2. 


6. 


1 


20 



• The iten was much too ^difficult as it stood. Only 5 of the 
60 pup ils represented in the table obtained the correct answer. An attempt was 
nade to nake distractor E less appealing. Perhaps it was preferred because it 
was longer than the rest, or. because it was-;so all-enbracing. The roasons for 
its popularity c an only bo surmised at this stage. 

The distractor E was therefore- changed to 5, 4 U . A choice thus 
hod to be nade between five numbers , and in this fora the question appeared in 
the final trial of the tost, with the following results: 



Response 


A. 


• ; ' • ; B • 


C 


D 


E 


Upper group (N=100) 


8 


4 


71 


'll 


6 


Lower group (N=100) 


7 


14 


60 


10 


9 


0 

►1: 

1 


reasons, 


distractor C 


had become 


the popular choice. 



The iten was still unsatisf ac t‘o ry as an evaluation instrument. Tho two main 
reasons for its xmsuit ability are: . 



1. Nearly as nany pupils who performed badly on the 

test as a whole (i.e, lower group) chose tho correct answer 
os pupils who performed well on the test as a whole 
(i.e. upper group)* The iten did not discriminate between 
high achievers and low achievers, and is thus of little 
value. 

2. The iten was still too difficult. Only about one-fifth 
of the pupils tested obtained the correct answer. 

The iten oust be discarded as an evaluation iten. It noy. have 
uses in the classroom but its value for measurement purposes is non-existent. 



It is interesting to reflect on how many test questions which 
appear to bo suitable on the surface but in fact have little value, have been 
used in schools* An even more disturbing situation occurs when more of the 
lower group choose the correct response than of the upper group, and the item 
is working against the abler pupils. This . situation is not uncommon. 



Classification of. I tens 

• A necessary preliminary to the construction of an iten bonk 



is a classification systou. This is necessary to ensure that items on a 
particular topic are readily obtained from the bonk, and also to ensure that the 
bank is comprehensive in that it contains items on, a wide range of categories. 



There arc two classifications necessary for each item: 

1, Sub.iect Matter Classification (i.e. topic). In the 
present case (form 3) the topics wore taken from Course of 
Study. Poms I to IV. V.U.S.E.B . As it is convenient to have 
each topic of rou ; :hly equal weight in terns of teaching tine 
in the classroom, some topics were divided and others combined. 
In this way each topic heading in tho classification syston 
assumed the some importance as far as the need for items is 
concerned. 
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2. Pupil response classification (objective). It is part 
of the ain of teachers of all subjects to produce changes in 

their pupils* Before suitable •evaluation- can talce place, it 

is necessary to decide on the nature of desirable changes so 
that test items can be constructed to measure the extent to 
which the teacher has been successful. Teachers have objectives 
in nind when they teach their pupils, and wish to evaluate 
the effectiveness of their teaching. 

Anyone who attempts to list the objectives of even the specialized 
area of mathematics teaching will soon 'become convinced of the difficulty of such 
a task, and it is doubtful if full agreement would bo reached with many other 
teachers. The task of defining Educational objectives has been attempted by many 
writers, perhaps the best laiown of which is on American committee headed by 
B.S. Bloom. This committee decided that teachers attempt to produce changes in 
their pupils in three main areas - 

1, The Cognitive domain - intellectual abilities and skills. 

2, The Affective domain - interests, attitudes, values otc. 

3, The Psycho-motor domain - manipulative or motor-skill 
activities. 

Within each domain, educational objectives were defined and illustrated. 

The work of this committee has been criticized for the very 
reasons that the writers advance as its strength. In attempting to define 
educational objectives covering all subjects, the particular contributions that 
each subject can moke nay have been overlooked. In any case, Bloom* s 
classification system nay be more suitable for professional tost constructors 
than it is for informal classroom testing. A simple system should suffice. 

Ms Project is restricted at present to the evaluation of 
intellectual abilities and skills. In the area of school mathematics, four 
types of pupil response can bo distinguished. These ares 

(a) ability to recall; 

(b) ' ability to apply standard processes; 

(c) ability to choose the correct response; 

(d) ability to devise an original method. 

These four catagoiles are defined fully, with examples in. the 
following table. 



CLASSIFICATION OP OBJECTIVES IN MATHEMATICS 

1. Ability to Recall - reproducing standard theorems, symbols, dofinitibnidji 
formulae, proofs, etc., which are required to be coonittod to memory, 

e.g. What does a probability of a imply? 

At what point does the graph of y = 3x + 4 
intersect the y-oxis? 

Prove the angle in a semi-circle is a 
right angle. 

Standard’ geometrical constructions. 1 \ 



5 



o 



5 



1 2. Ability to At>p1y Standard Processes - applying standard routing f omul no 
and other processes in which there has been extensive practice* No choice of' 
nothod is involved; the situations arc fcnilior, 

'•2 2 

eig» ‘ 'Factorize 16x — 9y 

t o N 

Find ^x:x - x - 1 « O j by tlie "formula" nethod. 

Simplify 

3« Ability to Choose tho Correct Process - applying standard processes but firstly 
choosing the correct one* The pupil nust "typo" tho question* There is the • 
possibility that an incorrect choice nay be node, 

e*g* Trigonometric identities. 



Geometry riders. 



Problems requiring a diagram to bo drawn 
froii : 'data given* • 



Ability to Devise cn Original Method - no ” taught” nethod is available - 
the problem cannot bo "typed" and requires insight, understanding of basic concepts, 
etc*, in p novel situation, 



c*g* 7/hich single digit, when doubled, 

2 

.JE i 

i 



doubles the fraction 



Sene Commonwealth Seconder:,’’ Scholarship examination quest! 9113, 



Iten3 con new be classified in two way 3, subject natter and pupil 
response* For a complete item banlc, itons ore needed covering ovary topic and 
every type of pupil response* For tills purpose, a grid was constructed along 
tho followii^ linos: ! 

Objectives 

| 1 ; 2 3 4 

“l 1 
2 

Topics ^ 

4 

etc* 



Some colls of this grid cannot be filled vdlii itoua because not '* 
every topio that is studied con produce results in every objective* Many topics 
aro studied in schools because of the change’s they can produce towards one or. two 
of tho objectives only* . 



1 ' i l | r •. , 

Tho complete grid for this foirr.i 3 study is reproduced on thenext 
page, an^ the i twenty questions that arc : the concern of tills report arc placed. In 
their appropriate colls* 
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FORM 3 TOPIC -CATEGORY GRID 



j CATEGORY 

J L 



Sets of Rational Nunbors 



Expansion of brackets . Dictrib. law 

Factorisation 

Mensuration 

Fractions 

Mult. 8: Div. 

Add & Subtr. 

Partial Fractions 

Solution sets by factorisation 



Sets of Real Numbers 



Square roots 

Field laws & other properties 
Indices 

Logs and std. form 
Other tables 
Pythagoras 
Trig, applications 



Relation and Function 



Linear graphs 

Linear equations (algebraic) 
Simultaneous equns. (graph) 

Travel graphs etc. 

Simultaneous equns. (algebraic) 
Quadratic functions 
Quadratic graphs 
Quadratic equations (alg.) 

Graphs of c? and log functions 
Translation to algebraic fom 
Theory of sine, cos, tan functions 
Formulae 



Deductive Proof * 



Use of symbols & terms 
Angle sun of A, & applications 
Parallelogram 
Isosceles , 

Angles in circles 



Additional , 

Similar *s 

Congruent f\ *s 
Symetry 

Linear inequations (olg.) 
Miscellaneous 
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CATEGORY 

2 



Q.1 



Q.9 



-Q.13- 



Q.5 



Q.2 



Q.10 



Q.14 



Q.8 



Q.17 



Q.19 






CATEGORY 

3 



Q.3 



Q.11 



Q.15 



CATEGORY 

* 



_Q.4 



Q.12 



Q.16 



Q.6 



Q.1 8 



Q.7 



Q.20 



. y 
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Itens Used in This' Teat 

'’In order to disrupt tho normal timetables in the trial schools as 
little cs possible, twenty items were selected and grouped together as a test. In 
this way, all that was required fron a school was tho availability of a form 3 
class for ono period, Pour questions, one fron each objective category, 
wore chosen in each' of tlio following five topic areas 

Graphs , • 

Congruent triangles, 

Factorisation, 

Use of .symbols, 

Real number system. 

There were thus five questions in each objective category, caul the twenty itens 
ceno from twenty different cells of the lorn 3 gild# As a result of the preliminary 
trial of these items, tliis scheme was disrupted slightly because some itoos were 
shown to be unsatisfactory, and alteration of then caused one cf then to be 
displaced iron its original cell. 

Preliminary Trial 

; * . The items were administered to one class in each of the coeducational 

•^“high schools in tho metropolitan area# The total number of pupils tested at /this 
stage was -’ll 6# The Schools were chosen as representing a reasonably wide range of 
• pupil typo, being' located in different socio-economic areas, end widely separated 
geographically# •’ 'There was no need to sample randomly at this stage as no conclusions 
were —to be'dfafe from the pupils* responses other than that the items appeared 
satisfactory or unsati sf nc tory for the main trial. The purpose of a preliBiiitay 
trial is to point up weaknesses in the structure of questions (poor wording, 
typist’s erirorsV two correct answers, etc,), and reveal distractors wliich are 
•either- 'too appealing Or not sufficiently appealing (too obviously incorrect otc#). 
Obviously if such faults can be rectified before the main trial, much time and 
effort vd.ll be saved# 



On tho basis of the pupils’ responses, 14 of the questions were 
considered satisfactory for further trial. Of tho reminder, minor alterations 
were made to 5 in on endeavour to make thcr. more suitable. These alterations 
usually consisted of replacing one or two incorrect distractors which were too 
appealing, or providing more dues to tie correct answer in the stem of the question 
in an effort to moke it less difficult. Tho remaining question was extensively 
changed, (This is tho question. described in the early part of this report, 
concerning the factors of 3n.)- 

Tho questions were then duplicated in their final foim, ready for 
trial. As a result of tho alterations described above, tho test now covered 6 
topics instead of 5 but there wexo still 5 questions in each objective category# 

The questions arc reproduced at the end of this report# 

Sample 

It is necessary when choosing a sample to ensure that every member 
of the population has an equal chance of being included. This is the basic 
requirement of random sampling# Unless this is done, tho various statistical 
techniques that • oan;.,bo' : 'applicd to the responses may not give correct results. 

A be^tep pro cedure, ’of course, is to try tho items Qut„on. the.. whole population 
(in this case, all form 3 pupils). The Tiecd for sampling procedures is brought 
about because of the impossibility of trialling the whole population# 

Before a sample is taken, the population must be clearly defined. 

In this ease the population was chosen to bo all form 3 pupils attending 
co-cducational high schools in tho metropolitan area, in 1969# Any results 
obtained from a sample of this population cannot bo applied to pupils out oi do 
the population. F or example, pupils ot~aingl«-eex high schools, country high 
schools, girls secondary schools, etc., may perform quite differently# Results 
obtained for ono population cannot with certainty be extrapolated to a different 
population, although inferences can be made in many cases vdth little possibility 
of error. 
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The larger a scnple can be nado, the noro accurate will be the 
results obtained for the complete population. The nost connon nethod of achieving 
a satisfactory randon scnple is to assign a nunber to each nenber of the population, 
and then use a table of randon numbers to select the sample. Other c canon methods 
ore to include all members of tho population with birthdays on a certain date 
(selected randomly), or every fourth (or fifth or twentieth etc,) person from 
an alphabetical list. 

Many '’random'’ samples are not randon at all because the sample is 
selected from a different population from tho intended ono, A sample of Melbourne 
residents selected from a telephone directory is really only a sample of Melbourne 
residents listed in this book, and conclusions obtained will apply to thie select 
group only and not the overall population. Similarly, if all people whoso surnames 
begin with a certain letter axe chosen as the sample, then various rational groups 
will be either over-represented or under-represented, (for example, the "Macs" 
or the 0*Briens are either all in the sample or all out of it). 

If the population contains distinct groups which may perform 
differently on the experimental material, it is permissible to obtain a randon 
ample from each of these groups* Those, small random samples can then be combined 
to form -a random sample' of the population as a whole. The sample so obtained .is 
colled a. stratified randon. sample. It is necessary to keep the proportion . of 
..subjects- chosen for the sample .constant in all of the groups, 

.. . For example, - suppose a random sample of high school "teachers' 
iax.de sired, and that one in twenty are to bo included in the sample. A simple . 
.random sample eould.be obtained by - assigning each teacher a number and selecting: 
the sample from a table of. fandom numbers. Alternatively, the population could . 

• •• *be stratified’ according to their classification, and ono in twenty principals, 
senior teachers, assistants, etc. could be chosen. As most teachers have a 
number in the classified roll for promotion purposes, this method would_.be 
easier, than the simple sample method. 

Alternatively, all the teachers in randomly -selected schools., 
could be included in the sample. In this way, the proportions *©f -seBior-teaGhers , 
unqualified teachers, maths teachers', men married teachers etc. would be correct. 

If in addition the schools were stratified before a sample was chosen, the 
"result would probably be even more acceptable. It could be decided to select 
all the teachers in one-twentieth of country schools and of suburban schools, 

• - .. or grade Ay B, C, I) high schools. As long as the same proportion is chosen, 

from each stratum, and. every teacher has an equal chance of being included in 
the sample, then the sample \7ill be a randon one. 



In. this study, it was decided to include all the pupils, in 
randomly-selected classes. ' This decision was made for obvious administrative 
reasons, fhe problem was thus reduced to choosing classes, which is a. simpler 
matter than choosing individual pupils. Before selecting the classes, it was 
decided that two important variables to be considered were tho geographical 
distribution of schools, .and the size of schools. A t7/o-stago stratified random 
sample of schools was thus made, and a third form class was then selected 
randomly from each chosen school. 



The following table sum arizes tho distribution of large and 
small high schools in the metropolitan area (1969), which fitted the 

definition of the population 1 (i.o., cO-ed high schools). 

• ■ ' . : ' . * .* • ... * 

Metropolitan Area ' — 



1 • • . 


'North' 


South • 


East 


West 


Large schoo3.s (A & B grades) 


28 


13 . 


32 


• 9 


Small schools (c & D grades) 


7 . . 


. 4' 


11 


1 
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It was decided to test one class in each of eleven schools, so 
approximately one in nine of those schools must be selected randomly. 
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The required numbers were : 





North 


South 


East 


West 


Large sohools 


3 


1 


4 


1 





East 


Other 


Small schools 


1 •. 


1 



The schools in each of the six categories were assigned a number, 
and by using a table of random numbers the eleven schools which were to 
constitute the sample were obtained# 

The class that was to be tested within each chosen school had now to 
be selected# This was done by contacting the schools and nominating a time that 
would bo suitable. The schools were asked if there was a form 3 mathematics 
class operating at this time which could be made available# If this was not the 
cose, then another time was nominated# At no stage did a school nominate a class 
to be tosted# Any third— form class which contained both boys and girls, and studied 
mathematics for 7 or 8 periods per week was considered eligible for selection# 

Administration of Items . 

It is important that exactly the same instructions are given to each 
group of subjects which do the test# Most published tests include a very rigorous 
procedure to be observed by the administrator (for example, the Commonwealth 
Secondary Scholarships examinations). This is done so that variations from group to 
group reflect accurately differences between, groups, and are not i •.'•infestations of 
differences in administration. This is particularly important when more than one 
person administers the test# 

In this case, the front page of the test consisted of printed 
instructions to the candidate, together with a sample question and answer to 
illustrate the type of response required# No verbal instructions were given 
regarding the test# The class was allowed 3 minutes to read the instructions 
page, and then told to turn the page and commence# Thirty minutes v/eie then 
allowed for the test# 

All the selected classes were tested in October or November 1969# 

By this stage of the year, differences between schools caused by varying order of 
topic arrangements for the year are reduced to a minimum - all schools have 
finished the main work of tho year by this stage# 

Results 



The following table shows the distribution of total scores obtained 
by the pupils of each class, on the test as a whole# The highest possible score 
is 20. As can bo seen from the table, 317 pupils were tested. 

The concept of Upper and Lower groups has been explained earlier in 
this circular# In this case, these groups were obtained in the follow ing way: 

Lower Group 

(*) every pupil with a total score of 3 or less, 

(b) half of tho pupils frem each school with a total score 
O of 6, soloctod randomly* 

ERIC 
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Upper Group 

’ ; * 

(a) every pupil with a total score of 10 or noro, 

(b) every pupil with a total score of 9 f oxcopt for 
6 pupils who v/ero rejootod rcndonlyi no aoro than 
one frou each school, 

process gavo 100 pupils in each group - on easy nunb*.r to work 
with# Tno following tabic also shows how the groups wore constituted# 





Iv.'iul r 



ani 

Salootion of Umor aq il Low^r Orousi-i 



TOTAL 


—4 

_4 


_4 

o 


VO 


09 


-4 


ox 


vn 


4* 


VP 


ro 


mA 


i 

SCHOOL 




£ 






V* 

txl 




VP 

td 


VP 

o 


$ 




v>l 

> 


VP 


I 


ro 

IO 

mA 

VP 

Ol 

ro 

ro 

vo 

4* 

ro 

VII 

—4 

S 

ro 

a> 

mA 

VO 

_4 

ro 

O 

o 

o 

o 

• 

© 


1 

—4 

1 

mA 

VP 

KM 

09 

VP 

OX 

V>l 

VP 

1 

mA 

1 

1 

1 

1 

1 

1 

1 

1 


1 

V 

mA 

mA. 

KM 

KM 

CO 

mA 

vjn 

VP 

VP 

ro 

mA 

1 

1 

1 

1 

1 

1 

1 

1 


--1-1231553-1 1 - -- -- -- 


1 

1 

1 

vp 

4* 

VJ1 

vp 

VP 

VP 

VP 

-A 

1 

1 

1 

1 

1 

1 

1 

1 

1 


• i 

i 

i 

VI 

4^ 

4* 

$ 

ro 

ro 

ro 

I 

I 

I 

l 

l 

l 

1 

l 

l 


1 

1 

1 

1 

mA 

mA 

mA 

VP 

ro 

VP 

VP 

«■* 

VP 

1 

1 

1 

1 

1 

1 

1 

1 


1 

1 

1 

ro 

4* 

1 

VP 

VP 

VP 

1 

VP 

ox 

mA 

1 

mA 

1 

1 

1 

1 

1 

1 


1 

1 

1 

a ^ 

ro 

4* 

. -4 
VP 

1 

VP 

mA 

mA 

mA 

1 

«4 

1 

1 

1 

1 

1 

1 


1 

1 

1 

1 

4* 

VP * 
-4 
€0 
VP 

ox 

ro 

mA 

1 

1 

1 

1 

1 

1 


1 

1 

1 

1 

1 

mA 

4± 

VP 

mA 

ro 

VP . . 

VP 

VP 

1 

1 

1 

1 

1 

1 

1 

1 


1 

-4 

1 

ro 

OX 

VP 

4* 

OX 

* 

ro 

VP . 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


ex 

mA 

ro 

VP 

4* 

VP 

OX 

-4 

09 

VO 

_* « 
-* CO 

o 

- § 
^ n 

—4 

KM 

mA 

4* 

■ft 

VP 

mA 

OX 

■ft 

-4 

_4 

09 

«*' 

vo 

8 


























K 


























« 




$* 


09 


00 


& 


-4 


vo 


wf* 


OX 


-4 


VO 


OX 


| 


V* 

mA 


VP 


ro 


ro 


ro 


ro 


mA 


VP 


ro 


VP 


VP 


VP 




-0 


ro 


VP 


V>l 


vo 


vo 


09 


ro 


ox 


09 


4* 


■ft 


• 


•4 
























o a t« 


O 












mA 


mA 




■1 


ro 




N D O 


© 


•4 


vo 


vo 


V* 


4> 


o 


mA 


ox 


VP 


4* 


4* 


1 *8 " 












* 














**\S 


























O H tfJ 


























H 6 o 


o 


mA 




ax 


mA 


mA 






•1 


wA 




mA 


O Q • 


o 




VO 


ox 


4* 


ro 


VP 


09 


o 


o 


10 


4* 


n !S . 


























* * £ 



O 




o 



Analysis of Results 



i 



12 - 



Tho following statistics woro r.batraotod: ltora difficulty, item 

diaoriminatlon, end probability* Tho noonings of thueo toxras wo givon below. 

I ; 

(i) Item difficulty 1 



This io a measure reprooonting tho relative fruquonoy with which 
an item io correctly or incorruotly anaworod. It is usually expressed as a 
porcontago- ! 



o.g., if tho upper group 00 obtained tho correct answer and 20 
obtained the incorrect answer, and thoso results wore revorsod in tho lower 
group, thon 

no. wrong 100 
Difficulty# * total numbor x 1 

100 100 

“ 200 x 1 i , ■ 

- 50 #. 

Ma | I 

A difficulty of r$> moans that of the total upper and lower groups obtainod 
an incorrect answer. 

(ii) Item diaoriminatlon 

V. ! j This index indicates the usefulness' of tho item! It is a numerical 
moasuro showing how tho results for this itom relate to tho results for the test ; 
os a whole. If the item is to fit tho pattern of tho test as a whold , then ' 
obviously more of tho upper group should obtain the correct answer then of : tho 
lower group. If the numbers from both groups ore about tho same, then the item j 
does not discriminate be two on high and low performers. The tost would have been' 
just as satisfactory if tho iten had boon emitted. This is not to say that tho 
itons with satisfactory discrimination indices ore noasurin,, tho dosired traits 
bettor than others but sinply that tho iten "fits in" with tho toot uc a whole* 
Whothor the test actually measures tho traits it was intended to noasure is another 
aattor. i 



The index of discrimination thus expresses the oxtont to which 
each test iten discriminates between pupils, and relates this to the extent to 
which tho test as a whole discriminates betwoen pupilo. 



(iii) Probability 



. j I 1 

It is always possible that the results obtainod for an Item; could 
have beon due to a chance occurrenoe. The probability index oi an item is a 
measure of the likelihood of this. Generally, it 1s required that tho 
likolihood of the results being duo to. chanoo bo less thfcn 1 in 20 for tost items, 
although 1 in 100 is often demanded if: the tost icjto bo ‘used for particularly 
important purpooou* ' J j 

« • •• i i • ! ' | 

Tho fallowing tablo ounujiarisoe tho insults of tho item analysis. 
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Item Anal. vs 1 b 

(the correct onov/er ia undei'lined) 



Question 


• 

Group 


A 


B 


c 

• 


D 


E 


II. A. 


i 

Difficulty 


Item 

discriminate 


m Probability 


1 


u • 


31 


13 


3 


5 


2 












L 


41 


33 


10 


11 


3 


2 


41$ 


0.37 


< 0.001 


2 


U ■ 


12 


21 


19 


10 


7 


3 


• 








L 


19 


14 


17 


27 


15 


8 


63$ 


0.47 


< o.ooi 


1 3 


U * 


1 


1 


8 


[6 


82 


2 










I 


9 

I ' ' 


5 


27 


6 


42 


4 


"34$ 


0.34 


<0.001 


4 


U 


3 


0 


44 


ii 


5 


1 






» 

i 




L 


10 


1 


49 


26 


13 


t 

1 


63“$ 


0.22 

• • • t : • > i r.t..- 


; <0.01 

t 


5 


U 


21 


5 


'45 


4 


13 


.1 ; 






• 


• 


1 


22 


15 


32 


5 


30 


« < B 

; 5 : 


• 77$ 

i 


0.22 


<0.01 


6 


U 


14 


J58 


| 1 ■ 


24 


22 


•i ; 








; 


L 


1.1 


12 


5 


39 


29 


6 ' 


73$ 


0 # 28 

i. 


<0.001 

( 


7 


U 


2 


M 


3 


6 


5 






!■ 

L 

•i 
.i . 






L 


9 


21 


10 


25 


17 


2 


39$ 


0ii46 


<0.001 


e 


U 


0 


2 




1 


2 












L 


12 


7 


62 


9. 


. .9 


i 


22$ 


0.40 


< 0.001 

'i . , 


9 


U 


21 


2 


5 


2 


1 o 












L 


38 


9 


8 


1 


21 


5 


46$ 


0.31 


<0.001 


10 


U 


3 


a 


11 


31 


17 


3 








ERJC 


I . 


6 


1 


13 


36 


29 


7 


78$ 


0.33 


< 0.001 

























■ ■ qrorr ututt 


wTTTuT: 


' 


- 


T7™i 


» — r — 




rr r TYr | 






jit ir jban.Liiy 


i 


u • 


11 


13 


3 


5 


2 












L 


11 


33 


10 


11 


3 


2 


,• 41$ 


0.37 


40.001 


2 


U • 


12 


22 


19 


10 


7 


3 










L 


19 


11 


17 


27 


15 


8 

■■ 


63$ 


0.47 


4. 0.001 


3 


u • 


1 


1 


8 


.6 


82 


2 




■; 






L 


9 


5 


27 


6 


12 


4 


l "34$ 


0.34 


<0.001 


4 


• ■. 

U 


3 


0 


44 


12 


5 


1 


v 


; • 


i 




L 


10 


1 


49 


26: 


13 


1 


637^ 


0.22 


j <0.01- 


5 


U 


3k 


5 


45 


4 


13 


i 

. 1 ; 










L 


12 


15 


32 


5 


30 


; 5 ; 


; 77$ 


0.22 


< 0.01 


6 


U 


14 


22 


V 1 


24 


22 


i ; 


* ! * 






j 


L 


n 


12 


5 


59 


29 


6 


73$ ‘ 


0.28 


<0.001 


7 


U 


2 


M 


3 


6 


5 






j* 

r !*i 
.1 . 






L 


9 


21 


10 


25 


17 


2 


39/o 

i 

t 


0*i46 

•j 


<0.001 


8 


U 


0 


2 


25 


1 


2 












1 


12 


7 


62 


9 


. 9 


i 


22$ 


0.40 


< 0.001 


9 


u 


21 


2 


5 


2 


10 












L 


38 


9 


8 


1 


22 


5 


46$ 


0.31 


<0.001 


10 


U 


3 




11 


31 


17 


3 










L • 


6 


2 


13 


36 


29 


7 


W 


0.33 


< 0.001 


11 


U 


8 


4 


71 


11 


4 


2 










L 


7 


14 


60 


10. 


7 


j 2 


89$ 


< 0.02 


approx. 1 






j! 


I 




! 


1 
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Question... 


Group 


A 


B 


c. 


D 


E 


N.A. 


r 

Difficulty J 


ttein 

iiscrimination 

i • ■ 


Probability 


12 


U 


13 


12 


26 


26. . 


13 


0 


77% 


o:32 


<o;ooi 




1 


18 


15 


9 


39 


16 


3 








13 


U 


1 


,7 


2 


80 


10 


0 


42/ a .. 


0.44 ' 


< 0.001 




L 


7 


14 


7. 


.26 


29 


7 


> 






• 14 


U 


18 


17 


22 


5 r 


-22 


2 


; 74/5 


0,24 


< 0.001 




L 


27 


22 


16 


8: 


12 


12 








....... 15 . : ... 


U 


. IQ.. 


i? 


12 


» j 

M 


12 


4:.. 


6$ 


~ o;32 


< 0.001 ■ 




L 


24 


ii 


15 


12 


20 

i‘ 


11 - 


! 


? 1 

; i 

1 ! 1 




16 


U 


17... 


JSl 

9 


15 


.22; • 


.1 


, 2j 


: 61?$' - 


CVJ 

CM 

x •.. 

O 

j 


•< 0.01 




; l 

i 


14 


18 

I 


27 


21 


5 


9* 


l 


* J i 

; ii 

1 . *! ; 




17 


. . u 


3 


12 


13 


6o: 


11 


i 

11 

i 


58$; 


* • ; 1 

1 

0,35 


< 0.001 




L 


16 


15 


24 


2£ 


11 


9-. 


; f 


j; 




18 


U 


2 


19 


. 4 


3 


11 


i 

1 


41/5 


0.40 - 


>< 0.001 


• • • •• -* * 


L 


11 


39 


14 


11 


21 


. 4 • 








19 


; u 


8 


5 

l 


22 


7 


38 


3 


73 £ 


0.28 


< 0.001 




’ L 


4 


18 


11 


23 


34 


7 




ii '• 

1 f 

t i 

l • 




20 


U 


7 


13 


21 


10 


22 


6 


72/5 


0.36 


< 0 . 001 - 




L 


16 


35 


17 


14 


12 


6 




i 

— i 
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Nineteen of the twenty itens proved to be satisfactory in terns of 
discrininrtion.. between upper . and lower groups* (Q.11 was the unsatisfactory 
one, with discrimination under 0.02 and an oven c hence that the results 
obtained were not significant at nil). • 

Many of the itens could be classified os very difficult* While 
the percentage difficulties range fron 22$ - 78$, cloven wore over 60$ * 

This is satisfactory, if. the itons .are used with ..this in uind (for exonple , in 
conjunction with other itens) but taken together as a test, there wore too nany 
difficult itens for satisfactory results regarding achievement levels* 

The test, of course, was’ net intended to bo an entity but norely 
a collection of itens that wore being trialled. , Thus wo have nineteen itens 
for inclusion in the itcu bank at the fom three lpvel, and to act os prototype 
itens* 



avawav# 

*VV* ****** 
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EDUCTION DEPARTMENT - VICTORIA 

ommcuLUM and research branch 

SECONDLY M®EMTICS EVALUATION PROJECT 



DRAFT TEST NO. 1 



This test consists of 20 items* Each item. is followed by five suggested 



answers. 



You are to decide y/hieh answer' you. tliinic is the appropriate one , and 
then circle the letter of this answer on the separate answer sheet* Do not mark the 
question sheets in anyway. 



If you change your mind about an answer, cross out your first circle and draw 
another one around your final choice* 



Example 



The sum of two and two is: 
A. 3 ■ ' 



B. # 



C. 5 



D, 0 

E* none of A, B f C, D 



Choice E is the correct one, so the letter E is circled on the answer sheet 
ABC d(§1 



In many questions, you will find several choices which are partly correct, 
so you will have to decide which one is the best answer. 



Work carefully, but do not spend too long on any one item* If one item 
seems too difficult, leave it out and come back to it if you have time. 



Bo not mark the question sheets in any way. Rough working can be done on 
the sheet of foolscap provided, which need not be handed in. 



You have 30 minutes to do this test, 
BO NOT TURK OVER UNTIL TOLB TO BO SO . 
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1 . 



2 . 



3. 



4. 



5. 



The area measure of a parallelogram can be found from:- 

A, base measure x perpendicular height measure. 

B, a x base measure x perpendicular height measure. 

C, base measure x sloping height measure. 

B, 2 x base measure x (sum of measures of parallel sides). 

E. 2 x base measure x sloping height measure. 

What is the magnitude of the area of this circular region? 

A. 66 sq. ins. 

B. 346.5 sq. ins. 

C. 693 sq. ins. 

B. 33 sq. ins.. 

E, 173*5 sq. ins. 

Two regions have areas of the same magnitude. One region is bounded by a 
rectangle 16 ft. x 4 ft, and the other bya ..square* What is the magnitude 
of f. side of the square? 

A. IP ft. 

B. . 5 ft. 

C. 16 ft. 

B. 10 ft. 

E. 8 ft. 




In the diagram, part of the whole triangular region has been shaded. What 
fraction of the whole has been shaded? /\ 



A. 5/8 

B. 5/6 

C. 2/3 
B. 3/4 
E. 3/5 

If x and y are real numbers, which of 
2 2 

A. x=y x = y 

2 2 

B. x = y * x = y* 

2 2 

C. x = y x = y 

2 2 

B. x = y H x = y ’ 

_ 2 2 
E. x = y = x = y 




the statements below is the correct one? 






■j 




6 . 



On the number line below, £x : x 2 ^-4, x€R$ is represented by a closed .interval* 
Which of the following is the correct interval? 



A. CB 

B. BB 

C. BC 
B.H 
E.1I! 



A B C B E 

4 .. - * — I — -L- J I 1 I 1 l__J > 

. 5-4 -3 -2 -1 0 1 2 3 4 5 
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7 » x and y are two negative numbers. Which-of the -expressions - •. 
below must be positive? 

A 0 y x 

B. xy 

C* s^Ty 

Da x + y 

E. none of the above expressions .can be positive. 




% Which of the following statements is true? 

A. -7>-4 

B, . 0<-4 

0 P ~5<~3 - ' 

Do •’■S *i)& 

E* none of the above 0 • ’* 

!.i 0 Which one of the following sets- of numbers, should. be-inserted-ia. jthifi SRPtenoa-to 

make JLt-oorreot? 

^rational numbers] U * |real numbers^. 

A. ^integers} 

B. {negative numbers] 

C » £f ractions] 

Do ^unreal numbers^ 

Eo ^irrational numbers] 



10 . Which one of the following expressions ia not equal to (a+b).(i>-d) if-..®*** t 0_., 
and c~d ^ 0? 

..A, (b+a) (e-d) 

B. (b+a) (d~c) 

C. (c^JJ[a+b) 

D. -« (d-c). (a+b) 

E. (»«a*-ta) (d«*o ) 

t 

11 o Unsatisfactory Item 



12. If x and y are whole numbers, each, .divisible by-?, then - whieh^one- of" tha_f olio wing 
statements. is not necessarily true? 

A. xy is divisible by 49 ..... .• 



B. x 2 + y 2 i3 divisible by 7 
0. x + y is divisible by 14 

D. x - y is divisible by 7 

E. 7x is divisible by 49 



19 
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13. For the graph shown, an appropriate equation is: 




14. Which of the following aquations’ represents a straight line with gradient .2 . and 
y- intercept 1? 

♦ A, y a x + 2 . . . 



B« 2y= x + 1 
C. y + 2a m 1 

B. 2y • x s 2 • 

E. y — 2x s* 1 

15* For the graph of j(x,y); 3y = x-9| x,y£B^ the intersections with 1:he axes 
. occur where. 

•A. x =s -3 and y = -9 

. B. ( Xa'*'i/3 PX3*i y *-3 *■ .... • • 

0. x *» 1 and y = -9 
B. x = 9 2 nd y = -3 

. • * » 4 ' 

E, x = 1 and y = 3 

16. The graph of £(>:,y): y = 2x + 1, - where x and y£.K^> is a straight line,. Which 
of the statements suggested below is the best reason for justifying this? 

A. The intercepts on each axis can be found. 

3. . The 'equation contains a constant term, 1. 

0. One— tc-one correspondence exists between elements of the domain and range. 

t * ‘ • .' : • 

3. For every increase of .x value by 1, t lie re is an increase of y value by 2. 

E. The equation is a simple one, with small numbers. 



17* Which one of the following sets of conditions is not sufficient to show that 
triangles /&3Q ; and ESDJ are congruent? ... ; „ 




A* m(4A) = m(/l/ f m(Zt) = .m(3S) = m(iXl) 

. B. ss m(£L), m(AB) » m(x3i), m(ID) = m(33T) 

C. mOffi) s M(Ul) , mQCJ) ss m(’*3I ) , m(lJC ) *» ni(E!II) 

3. m(/£) = m(LG) * m(/N) 

32. m(5c) » m(5lr) 



o 
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18* Which one of the fol ] ovd ng fHflfrMiR-^nirbi^Pi-hH «ngi Ptx-AJuhinJn flayH!O4r4>e-H>013 grUmXt < ^ 




B. 



0 is the centre 





D. 




19* Which of the following transformations, when performed on a trial, .le ABC', will 
produce an image A*E , C I which may not be congruent to the original triangle? 

A, translation parallel to the x-axie 

B. rotation about the origin ’ 

0, dilation vith origin as centre 

D* reflection in the y-axiS . 

£• more than one of the above* . 

f 

20* One of the following sets of figures has all its members congruent* Which one is 
it? 

A* = ^parallelograms, each vith side length magnitudes 6", 6% 3", 3" $ 

B. c f parallelograms , each with aide length magnitudes 6", 6", 6 n , 6"^ 

C. = ^parallelograms, each with four right angles and one side length magnitude 

*6" V 

D. = ^parallelograms, each with angles of magnitudes 120°, 120*, 60°, 60* ^ 

E. ss (parallelograms, each with one right angle and side length ipagnitudes 

16", 6»; 6% 6” . 7 
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ANSWER SHEET 



NAME, 



FORM 



SCHOOL,. .... 



Circle the letter corresponding to the answer of your choice. The 
questions are grouped according to the page on which they occur. 



PAGE 1 



PAGE 2 



PAGE * 



PAGE 4 



QUESTION 1 . ABC 

2. A B C 

3. A B C 

4. ABC 

5. A B C 

6. ABC 

QUESTION 7. A B C 

8. A B C 

9. A B C 

10. ABC 

11. A B 0 

12. A B C 

QUESTION 13 . ABC 

14. ABC 

15. ABC 

16. ABC 

17. ABC 

QUESTION IB* ABC 

19. ABC 

20. A B C 



D 

1) 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 

D 



E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 
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